This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 



Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 



BLACK BORDERS 

TEXT CUT OFF AT TOP, BOTTOM OR SIDES 
FADED TEXT 
ILLEGIBLE TEXT 
SKEWED/SLANTED IMAGES 
COLORED PHOTOS 

BLACK OR VERY BLACK AND WHITE DARK PHOTOS 
GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



(19)/ 




(12) 



EuropfliSffas Patentamt 
European Patent Office 
Off ice europ^en des brevets (11) EP 0 744 705 A2 

EUROPEAN PATErrr APPLICATION 



(43) Date of publication: 

27.11.1936 Bulletin 1996/48 

(21) Application number: 96303561.3 

(22) Date of filing: 20.05.1 996 



(51) Int. CI.6: G06K 9/64. G06F 17/15, 
G03G 21/04 



(84) Designated Contracting States: 
DE ES FR GB IT NL 

(30) Priorfty: 22.05.1995 AU PN3100/95 

(71) Applicant: CANON KABUSHlKi KAISHA 
Tolcyo (JP) 

(72) Inventors: 

• Doneiy,Ross Alexander 
West Ryde New South Wales 21 14 Australia 
(AU) 



• DemetrloUiStantatios, 
Beecroft,New Soutli Wales 2119 Australia, (AU) 

(74) Representative: Beresford, Keltti Denis l^wls et 
al 

BERESFORD & Co. 
2-5 Warwick Court 
High Hotbom 
London WC1R 5DJ (GB) 



CM 
< 

in 



(54) image detection system 

(57) An Image detection system is disclosed for the 
detection of an image In an input pixel stream. An image 
is input as a input pixel stream (19) and accumulated 
and converted (112.113.114) into cells which are 
formed into cell data portions from regions of a corre- 
sponding image of the input pixel stream (19). A tem- 
plate storage ROM (15) stores at least one template 
that comprises a multiplicity of cell data entries derived 
from an desired image to be detected. A comparator 
matrix (115) is connected to the cell converter 
(1 12.1 13,1 14) and the tenrplate ROM (15) for compar- 
ing the cell data portions with a multiplicity of cell data 
entries to derive a tenrplate detection signal (21 5) when 
a predetermined number of tiie cell data portions match 
with the multiplicity of said cell data entries. The system 
finds particular use in the prevention of fraudulent copy- 
ing of images, such as bank noted using colour laser 
copiers and printers. 
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Description 

Reld of the Invention 

5 The present invention relates to detecting input Image characteristics In a stream of pixel data and has particular 

application in the detection of bank notes or the like so as to prevent forgeries or copies thereof being made. 

Background Art 

10 In recent years, the availability and quality of colour reproduction systems, such as colour laser copiers, coloured 
ink jet printers and colour offset printers has increased dramatically As a result of these increases in availability and 
quality, the incidence of forgeries being produced on such devices has also increased dramatically Ofcjviously an 
increased incidence of forgeries is of great concern to the genera! fabric of society Social concerns have risen to such 
an extent that the relevant authorities of various governments have seriously considered restricting or banning the use 

15 of these devices because of concerns over the increased levels of forgery 

There is therefore a general need for an inexpensive form of device that can detect when a document of value is 
being copied or printed and be able to disat>le the printing device so as to discourage its use in the production of forger- 
ies. 

20 Summary of the Invention 

It is an object of the present invention to provide a means for detecting the presence of certain images in an input 
stream of pixels with the consequential side-effect that the incidence of forgeries can t>e lessened. 

In accordance with a first aspect of the present invention there is provided apparatus for the detection of an image 
2$ in an input pixel stream, said apparatus comprising: 

(i) image input means for receiving said input pixel stream; 

(ii) cell converter means for forming cell data portions from regions of a con-esponding image of said input pixel 
stream; 

30 (iii) template storage means for storing at least one template, said template comprising a multiplicity of cell data 
entries derived from the desired image to be detected; and 

(iv) comparator means for comparing said cell data portions of said cell converter means with said multiplicity of 
cell data entries to derive a template detection signal when a predetermined number of said cell data portions 
match with said multiplicity of said cell data entries. 

35 

In accordance with a second aspect of the present invention there is provided apparatus for the detection of an 
image in an input pixel stream, said apparatus conprising: 

(i) image input means for receiving said input pixel stream; 
40 (ii) cell converter means for forming cell data portions from overlapping regions of said pixel stream, said cell data 
portions being divided into a series of phases with each of said phases having cell data portions derived from non- 
overlapping regions, 

(iii) template storage means for storing at least one template, said template comprising a multiplicity of cell data 
entries derived from a desired image to be detected; and 

45 (iv) comparator means for comparing said cell data of each of said series of phases of said cell converter means 
with said multiplicity of cell data entries to derive a template detection signal when a predetermined number of said 
cell data portions match with said multiplicity of said cell data entries. 

In accordance with a third aspect of the present invention there is provided apparatus for comparing a first prede- 
50 termined anay of cell data values with a second predetermined array of template data values, said apparatus compris- 
ing: 

(i) input means for inputting, a column at a time, said first predetermined anay of cell data values to a comparator 
matrix means; 

55 (ii) a comparator matrix means for simultaneously determining if said column of cell data values matches with any 
of a plurality of colunvis of said second predetermined array of template data values and to produce a column 
matching signal designating the said matched column of said second predetermined array of template data values; 
(iii) tally array means for storing said column matching signals for a series of columns of said first predetermined 
array of cell data values, and 
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(rv) template match detection means for deriving from 6aid stored column matching signals, a template match sig- 
nal signifying the occurrence of a match l>etween said template and a portion of said first predetermined array of 
cell data values. 

5 In accordance with a fourth aspect of the present invention there is disclosed an image processing method com- 

prising the steps of: 

inputting image data representing an input image; 

determining whether the input image includes a first pattern extracted from a first region of a specific image and 
generating a first determination result; 
10 determining whether the Input image includes a second pattern extracted from in a second region of the specific 

image and generating a second determination result; and 

diSCTiminating whether the input Image includes the specific image teased on the first and second determination 
results and positional information about the first and second regions. 

In accordance with a fifth aspect of the present invention there is disclosed an image processing method compris- 
15 ing the steps of: 

inputting image data representing an input image; 

extracting multi-value data for each of a plurality of cells conesponding to a region of the input image; and 
discriminating whether the input image includes a specific image by comparing the extracted multi-value data 
with multi-value template data for each of a plurality of cells corresponding to a region of the specific image. 
20 In accordance with a sixth aspect of the present invention there is disclosed an image processing method compris- 
ing the steps of: 

inputting image data representing an input image: 

extracting cell data for each of a plurality of cells corresponding to a first region of the input image; and 
discriminating whether the input image includes a specific image by comparing the extracted cell data with tem- 
25 plate data for each of a plurality of cells corresponding to a second region of the specific image: 

wherein the discrimination is performed by compensating a minute aberration between the first region of the 
input image and the second region of the specific image. 

Brief Description of the Drawings 

30 

A preferred emtxxliment of the present invention will now be desaibed with reference to the accompanying draw- 
ings in which: 

Fig. 1 illustrates a colour copier system of the preferred embodiment; 
35 Fig. 2 illustrates the printer of Fig. 1 in more detail; 

Fig. 3 illustrates a number of different possible orientations of an image to be detected in an output image; 
Fig. 4 illustrates the template structure utilised by the prefened embodiment; 
Fig. 5 illustrates the grouping together of templates; 

Fig. 6 illustrates the phase relationship of templates utilised in the preferred embodiment; 
40 Rgs. 7A to 7D illustrate the process of rotation of a template: 

Rg. 8 illustrates a numt)er of possible positions that a template could be located on an image desired to be 
detected; 

Rg. 9 illustrates the alignment of a template with a rotated l)ank note; 

Fig. 10 illustrates the determination of a relative position vector between a pair of templates utilised in the preferred 
45 embodiment; 

Figs. 11 to 14 illustrate the process of translation of a cell of a template; 

Fig. 15 illustrates the process of rotation of a cell; 

Rg. 16 illustrates the effect on a cell of scaling a template; 

Rg. 17 illustrates the process of determining a value range; 
50 Fig. 18 is a schematic block diagram of the detection module of Fig. 2; 

Rgs 1 9 and 20 illustrate the process of gamma correction; 

Rg. 21 is a schematic block diagram of the gamma correction unit of Fig. 18; 

Rg. 22 is a schematic block diagram of the front end accunrulator of Rg. 18; 

Fig. 23 illustrates the different template phases utilised in the preferred embodiment; 
55 Fig. 24 illustrates the data organisation of the accumulated data store of Fig. 18; 

Fig. 25 is a schematic block diagram of the phase sequencer of Fig. 18; 

Rg. 26 illustrates the data storage arrangement of the phase RAM of Rg. 18; 

Fig. 27 is a schematic block diagram of the comparator matrix of Rg. 1 8; 

Rg. 28 illustrates a first form of feeding columns from the phase RAM to the comparator array of Rg. 27; 
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Fig. 29 is a schematic illustration of one column of the comparator array of Fig. 27; 

Figs. 30 to 33 illustrate the process of determining whether a template match has occun-ed; 

Fig. 34 IS a schematic block diagram of a tally array of Fig. 27; 

Fig. 35 illustrates a second form of feeding columns from the phase RAM to the comparator array of Rg. 27; 
5 Fig. 36 illustrates simultaneously determining a match for a 0** and ISO*" rotation of a column; 

Fig. 37 illustrates the process of simultaneously determining a match for the 90° and 270** rotations of a particular 
column. 

Fig. 38 is a schematic block diagram of a comparator cell of a comparator array of Fig. 27; 

Fig. 39 is a schematic block diagram of the detection sequencer of Fig. 18; 
10 Fig. 40 illustrates the data storage format of the template matching queue of Fig. 26; 

Fig. 41 illustrates the definition of the distance between two templates; 

Fig. 42(a) to (d) illustrates a number of possible rotations of two templates; 

Fig. 43 is a schematic block diagram of the correlator of Fig. 39; 

Fig. 44 is a schematic block diagram of the transform data unit of Fig. 39; 
15 Fig. 45 is a schematic block diagram of the write address generator of Fig. 39; and 

Fig. 46 is a schematic t}lock diagram of the read address generator of Fig. 39. 

Detailed Description 

20 The preferred emtxxliment of the present Invention is desaibed with reference to an arrangement configured for 
incorporation in a colour laser copier system 1 , such as the Canon Colour l^ser Copier sold by Canon Inc. of Japan. 
Further, the preferred embodiment can be readily applied to colour printers such as Models P320 and P330 also sold 
by Canon Inc. Refemng now to Fig. 1 , such a colour copier system consists of a scanner 2, capable of scanning an 
input image to a very high resolution, for example 600 dots per inch (dpQ. The scanned image can be fed, on a pixel by 

25 pixel basis, to a computer arxl control system 3 which is able to manipulate the scanned Image, for example by provid- 
ing scaling or transforming functions. The resultant pixel image is then fed to a printer 4. again on a pixel-by-pixel basis, 
where it is printed on a medium, such as paper. The scanned image from scanner 2. normally consists of separate col- 
our channel information for each of red, green and blue (RGB) colour portions of the scanned image, which Is com- 
monly known as an additive colour format. The printer 4 generally prints out the scanned image by means of a four pass 

30 sutitractive colour process. The four pass printing process normally consists of separate passes for the Cyan, Magenta, 
Yellow and Black (CMYK) portions of the scanned image. As the printer 4 operates on a four pass process, the image 
on scanner 2 is also normally scanned once to obtain the RGB colour portions which are subsequently converted to 
one of the Cyan, Magenta, Yellow and Black portions as required. 

As shown in Fig. 2, the printer 4 consists of a printer controller 6 and a print engine 7. The printer controller 6 

35 includes a colour converter 8. which takes as inputs the additive colour components. Red. Green. Blue (RGB) and 
derives the required subtractive colour component (CYM or K) for the required pass of the printer 4. The subtractive col- 
our components (MCYK) are supplied to the printer 4 frame-sequentially. The colour converter 8 can be implemented 
by a number of different methods, known to those skilled in the art the actual method used not t)eing relevant for the 
purposes of the present description. 

40 Tlie print engine 7 includes a modulation circuit and laser driver 1 1 for aeation of the required image on an elec- 
trostatic drum for 8ut>sequent transfer to paper or other print medium. A sequence controller 1 2, including an internal 
central processing unit (CPU) 18. is responsitsle for the overall operation of the print engine 7. Additionally, there is pro- 
vided a detection module 14 which is preferat)ly placed in, or alternatively arranged to monitor, the pixel stream 20 out- 
put from colour converter 8 to the modulation circuits 1 1 . The detection module 14 is configured to monitor the pixel 

45 stream 20 to detect an attempt to print out an image of a bank note or the like and to 't>lank out" pixel data on an output 
19 of the detection nxxlule 14 when such an attempt is detected. The detection module 14 is designed to detect a 
number of different possittle t^nk notes or other possible candidates for unwanted duplication and includes a read-only- 
memory (ROM) 15 for storing template information derived from the different image candidates. The template ROM 15 
interacts with a detection application specific integrated circuit (ASIC) 16 which performs all the control operations of 

50 detection module 14. 

Referring again to Rg. 1 , the scanner 2 of a colour laser copier such as Canon's P320 forms a pixel stream of data 
on a line by line t>asis with approxinnately 7,232 pixels per line and 1 1 .456 lines per scanned page. This pixel stream is 
normally generated at a rate in the vicinity of 22.5 million pixels per second. 

Turning now to Rg. 3, there is illustrated schematically a scanned image 23. TTiis scanned image has a number of 
55 bank (monetary) notes placed at various orientations and rotations which are required to be detected by the detection 
module 14 of Rg. 2. Hence, the detection module 14 is designed to detect a number (one or more) of different bank 
notes 22 at different possible positions or rotations in the scanned image, in addition to detecting enlarged or reduced 
bank notes in the range of approximately 95 %-1 05 % of the input image size. The detection nxxJule 14, is designed to 
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detect bank notes by means of comparison of the pixel stream with a "template" stored in the ROM 15 so as to detect 
the occurrence of the template within the pixel stream. 

Referring now to Fig. 4, there is shown a template 25 which consists of a 9x9 array of cells 26. Each cell 26 is 
designed to be compared with a block of 128x128 pixels. As will further be described hereinafter, each cell 26 contains 
5 information about the colour or brightness of the con-esponding block of pixels which should be present at that portion 
of the image. 

It is necessary for the detection module 14 to detect bank notes at all possible rotations and positions. As ttie 
number of possible rotations and positions is extremely large, it is unrealistic to store a template for each possible rota- 
tion or position. However, if each cell contains a range of information atx>ut the colour and brightness at that position of 

10 the bank note, it is not necessary to store all possitrfe orientations. The average colour and brightness of the block of 
pixels corresponding to a single cell remains substantially the same in value for template orientations which are very 
near in position and/or rotation to an initial tenrplate. Therefore, template orientations which are very near in position 
and rotation can be grouped together so that only one template comparison operation is needed for each group. In Fig. 
5, there is shown an example of two templates 28. 29 having the same rotations but slightly different alignments. The 

IS two templates 28, 29 are said to be in the same group If their top left hand corners lie within a group area 30. Therefore, 
all corresponding translations of template 28 whose top left corner lies within ttie group area 30 are also considered to 
be in the same group. Additionally, all rotated templates whose rotation is less than 6.4 degrees and whose top left hand 
corner also lies in group area 30 are also considered to be within tiie same group. The use of tiie group area 30 sub- 
stantially reduces the number of required comparisons to be performed by the detection nxxJule 14 to a reasonable 

20 level. The smaller tiie group area size 30, the nrK>re likely that a translated or rotated tenplate witiiin the same group is 
likely to produce similar cell values. For the purposes of the prefen-ed embodiment it was found that a group area 30 
which is one quarter the area of one cell 26 (Rg. 4) was suitable. 

Consider initially the simple case of detecting a template in an image without any rotation. In order to accomplish 
this tasK the scanned page Is divided into group areas and a template comparison is carried out for each group area. 

25 As mentioned above, the selected cell area is four times the group area. Therefore, to search for a template, a conpar- 
ison is initially made for the group area at ttie top left hand corner of tiie scanned image page. Next, a comparison is 
made against the group area offset half a cell to the right of the top left hand corner, then half a cell down from the top 
left hand corner, tiien half a cell down and to the right of the top left hand corner. Once all ttiese comparisons have been 
made, the equivalent of a wtx)le cell has been covered and the process can move to the next cell position to perform 

30 the same comparisons. 

Turning now to Fig. 6, there is shown an exanrtple of tiiis process. Five templates 32-36 are shown superinposed 
on top of one another. Tenrplate 32. as the tx>ttom-most template, has only a small portion of its top left hand corner 
visible and Is In the top left hand corner of the image to be printed 37 and is designated to be at position (0,0), phase 
0. Template 33, the second bottom template, is offset half a eel! distance to tiie right of template 32 and is designated 

35 to be at position (0,0), phase 2. Template 34 is positioned half a cell below tenptate 32 and is designated to be in posi- 
tion (0,0), phase 1 . Template 35 is positioned half a cell below terrplate 33 and is designated to be in a position (0,0), 
phase 3. Template 36, being shown as the topmost template is designated to be in a position (1,0), phase 0. 

The four templates 32-35 have corresponding group areas which cover the cell of the top left hand corner. In the 
preferred embodiment there are four phases per cell position. Of course, the number of phases per cell is dependent 

40 on the ratio between the cell area and the group area. If the group area was chosen to be a ninth of the cell area, nine 
phases wouM be required. As will be seen hereinafter, this would increase the computation requirements necessary in 
the detection module 14. 

Consider now the case of rotation. A separate template of a portion of the bank note is stored for every 6.4" of rota- 
tion. This is equivalent to fourteen templates being stored in the ROM 1 5 (Fig. 2) for 90" of rotation. It is only necessary 

45 to store the first 90" of rotation as the other rotations (up to 360") can be easily obtained from tiie original by swapping 
the template cells around by multiples of 90". Referring now to Figs 7A to 7D, there is shown an original template 40 
and rotated templates 41 , 42, 43 which can be derived from the original template 40 by rotation tiirough the simple rem- 
apping of cell address index values. 

The fourteen templates having rotations between 0 and 90" do not necessarily have to be in tiie same position on 

50 the bank note which is to be detected. The position of the template can be chosen so as to maximise its usefulness. 
Referring now to Fig. 8. there is shown an exanrple of multiple templates 45 having differing rotations arranged on a 
bank note 46. 

Turning now to Fig. 9 there is shown a scanned image 50, including a rotated bank note 51. A tenplate 52. 
designed to detect this particular rotation of the bank note 51 , is also shown. Importantiy. the top and bottom edges of 
55 the template 52 are chosen to be aligned with the lines of the scanned image 50 which, of course, are not necessarily 
the same as the edges of the banknote. This suljstantially eases the implementation requirements for detection of the 
template 52 in a line by line pixel stream corresponding to the scanned image 50. 

Referring now to Fig. 10, preferably a pair of templates 54, 55 is stored for each possble rotation (between 0 and 
90") of tiie bank note 56. This allows the detection nxxlule 14 (Fig. 2) to substantially reduce the occurence of false 



5 



B , ^ EP 0 744 705 A2 ^ 

positive detections as each template 54, 55 can be detected and a relative position vector 58 between the pair of 
detected templates can be measured. H this relative positional distance 58 is approximately equal to the expected 
length and direction of the relative positional vector of the scanned pair of templates, then a match can be determined 
to have taken place. 

5 As discussed previously with reference to Fig. 4, a template 25 is made up of a series of ceils 26. A template is 

conrpared with an input image by comparison of all of its cells with cells made up from the input image. If all the cells 
match, the template is determined to have been detected. The detection module 14 works on detecting the image from 
one colour pass of the pixel stream, with the colour pass preferably being magenta. 

TTie information stored for each cell of a template in tiie ROM 15 is a pair of 4 bit numbers (M IN, MAX). To compare 

10 a cell against a block of 1 28x1 28 input image pixels, an average of the input image pixel values is calculated. This aver- 
age is then rounded to four bits and if the final value is within the range (M!N,MAX), the cell is determined to have been 
matched. Ttie range (M IN, MAX) is called a value range. The value ranges are stored in the ROM 15 arxJ are precalcu- 
lated as will be further described herein. In general, the width of the value range (MAX-MIN) depends on the portion of 
the bank note from which the value range comes. Areas with little variation in colour (eg. plain white or plain black 

15 areas) produce narrow value ranges and areas with large variation in colour intensity (eg. a face) produce a wide value 
range. The use of value ranges allows for small changes in position, rotation and scaling of the image relative to the 
template. Further, the use of an average value for an area of pixels is chosen because of its simplicity to calculate and 
its insensltivity to small changes in position and rotation. The use of 4 bit numbers is further chosen in the preferred 
emtxxliment to simplify hardware requirements and reduce the necessary ROM storage space. 

20 The relevant value ranges for each cell for a particular bank note are predetermined using the following method: 
The bank note is scanned by a connputer system at the resolution at which it is to be printed and the magenta com- 
ponent is extracted and stored in a general computer system. For each required rotation e (0 s e s 90*»). the computer 
system perlbmrts the following function: 

25 1 . The bank note image is firstly rotated by an angle O using known computer graphics techniques for rotating 
images. 

2. The bark note image is then low pass filtered through the convolution of the image with a square box function 
being 128x128 pixels wide. 

3. For each possible position of a template on a bank note, a "merit" value is calculated. Possible positions of tem- 
30 plates are those where all four corners of the tenplate lie within the original image or note, except where two oppo- 
site corners lie outside the image. This is to cater for cases where the width of the bank note is less than the size 
of the rotated template. The merit of a tenplate position is the product of a template's "entropy" and flatness". The 
entropy of the template is measured by calculating the sum of the differences between adjacent filtered pixel values 
in the template. Therefore the entropy is a measure of how much tie brightness varies over the whole template and 

35 helps determine how useful the template will be. Clearly, a template which is a plain white is not of great use. The 
flatness of a template is a measure of the range of values over which the template varies over each cell. 

4. For each possible pair of template positions on the bank note which do not overlap, the product of each tem- 
plate's merit is calculated. The pair with the highest product is used to determine the two positions of the template 
on the bank note. 

40 5. Once the template position has been chosen, the conresponding low pass fiftered image is sannpled. The sam- 
pling process involves calculating, for each cell in the template, the minimum and maximum 4 bit numbers that the 
cell can have. In order to allow the translation and rotation within a group area, in addition to scaling, the position 
of each cell is allowed to vary 

45 Turning now to Figs. 1 1-16 the process of accounting for translation, rotation, and scaling will now be described. In 
Fig. 1 1 . there is shown tiie single template cell 26 of Fig. 4. As discussed previously witti reference to Fig. 5. each tem- 
plate is able to undergo translational hiovement so long as its top left hand corner remains within the same group area. 
Therefore cell 26 can be translated to the right as shown in Fig. 12. It can be further translated vertically down as shown 
in Fig. 13 and vertically and to the right as shown in Fig. 14. The top left hand corner of the cell 26 therefore can map 

so out an area 220. Each of the pixels within ttie area 220 represents a point on which the top left hand corner of tiie cell 
26 couM begin. 

Addrtionally. as noted previously a template is stored for each 6.4 degrees of rotation. As seen in Rg. 15. tiiis 
means that the portion 220 of Fig. 14 can undergo a rotation of 6.4 degrees around a centre point 221 of tiie tenplate. 
Therefore, taking into account the effects of translation and rotation, an area 222 will represent those possible values 
55 taken by the top left hand corner of the cell 26 under the effects of translation and rotation. 

Rnally. the preferred enrtoodiment is configured to operate under the effects of scaling, including enlargement arxJ 
reduction in ttie range of approximately 95 %-105 % of tiie original input image size. Turning now to Rg. 16, this is 
equivalent to a translation of the area 222 radially away from the cenfre of the terrplate 221 to form area 223. in addition 
to the translation and scaling of the area 222 radially towards the centre of the tenplate 221 as indicated tTy area 224. 
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The convex hull 225 around the areas 222-224 represents the final area for which the top left hand edge of cell 26 can 
take, "merefore, for each cell within the template 25 of Fig. 4. the calculation of the convex hull is carried out and for 
each possible cell position, the low passed filtered image is sampled. Tbe minimum and maximum values obtained for 
the samples then t>ecome the range of values that a cell can take. 

5 Each different possible position produces a different value for the average of the cell. As shown in Rg. 1 7. in order 

to account for further noise in the input pixel stream 20, the range of values is Irrcremented by adding a margin to each 
side of the range. It is assumed that these calculations are carried out using eight bit pixel value quantities, which Is a 
standard format utilised in the art. The addition of the margin also allows for changes due to faded or dirty bank notes 
in addition to inaccurate calibrations. However, the choice of the size of the margin is important. If the margin is too 

10 small, the detection module 14 may fail to detect the bank note. and. if it is too large, the detection nxxiule 14 can falsely 
determine the detection of a Ijark note. Rnally. the value range is reduced to a 4 bit number by extending it outward as 
shown in Rg. 12, to the nearest 1/16 tXHindary. 

Referring now to Rg. 18. there is shown the detection ASIC 16 of Rg. 2 in more detail. The detection ASIC 16 
includes a number of input/output interfaces including video data interface 81 for receiving the pixel data stream 20 from 

15 the printer controller 6 (Rg. 2) and for providing the pixel data output 1 9 to the modulation and laser driving circuitry 1 1 
(Fig. 2). A printer controller interface 82 is provided for interconnection with the sequence controller 12 of the print 
engine 7 (Rg. 2). A ROM interface 83 is provided to connect detection ASIC 16 to the template ROM 15 (Fig. 2) via a 
ROM interface unit 164. 

In Table 1 betow there is shown those inputs conprising the video pixel data interface 81 . During normal operation 
20 the "print" signal indicates that a new page of video pixel data is arriving from the printer controller 6. The pixel data 
stream 20 is sent in a four pass process, so the detection ASIC 16 synchronises to the pixel data stream 20 of the cor- 
rect colour, which in the prefened embodiment is magenta. Each new colour is signalled by the "top" signal. When no 
forgery is detected, the pixel data is passed straight through the detection ASIC (vdo_out). If a forgery is detected, the 
vdo_out pixel data is blanked out by the detection ASIC 16. Additionally, the vclk_out pixel data clock can also be 
25 blanked out further preventing the output of pixel data. 



Table 1 



Video Pixel Data Interface 


Name 


Type 


Definition 


vclkjn 


input 


video data clock from video interface 


Isync 


input 


line sync from video interface 


top 


input 


top of page signal from video interface 


prnt 


input 


print signal from video interface 


vdojn (7:0) 


input 


pixel data from vkleo interface 


vclk_out 


output 


video data clock to printer engine 


vdojout (7:0) 


output 


pixel data to printer engine 



45 Referring now to Table 2. there is shown the signal definitions of the standard ROM interface 83. The ROM interface 
83 is provided for connection with up to four megabits of ROM 15 (Rg. 2). 



so 
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Table 2 



ROM Interface 



Name 



Type 



Definition 



rom_a (18:0) 



output 



ROM address 



rom_d (15:0) 



Input 



ROM data 



romO oe 1 



output 



programmable ROM output enable 



roml oe 1 



output 



programmable ROM output enable 



The printer controller Interface 82 includes a detection signal for notifying the sequencer controller 1 2 (Fig. 2) when 
a template image has been detected. Additional signals provided by the printer controller interface 82 include a config- 
uration signal for initialising the detection module 14. in addition to en-or signals Including a IEEE standard 1149.1 - 
1990 Test Access Port Interface (TAP) 85 which can be provided for writing to and testing all internal registers of the 
detection module 14. 

The pixel data 20 is fed from the video data interface 81 to a gamma correction unit 86. TTie gamma correction unit 
86 is responsible for transforming the input video pixel data using a lookup table which is loaded from the ROM 15 dur- 
ing a startup sequence, in addition to blocking output video pixel data In the event of forgery heing detected. The pur- 
pose of gamma correction Is to ensure that the brightness vines utilised by the detection module 14 are evenly 
distributed to the human eye. The minimal detectable change (MDC) is the smallest amount of change in brightness 
(expressed as an eight bK number) needed for the eye to notice a difference in brightness. For an evenly distributed 
brightness, the MDC is the same for all brightness values. Referring now to Fig. 1 9, there is shown a graph of perceived 
brightness verses output value. The lower curve 88 shows the normal perceived brightness function of an output image. 
This curve 88 includes a lower portion 89 where perceived brightness changes very slowly and a upper portion of the 
curve 90 where the brigtitness changes rapidly The purpose of gamma correction Is to alter the perceived brightness 
curve so that it takes the form of a curve 91 which has an evenly distrBDuted perceived brightness. Referring now to Rg. 
20, there is shown a gamma correction mapping to translate the curve 88 to the curve 91 of Fig. 19. The gamma cor- 
rection curve includes portions 93 and 94 where there is a rapid change to counter the slow change perceived by the 
eye and a portion 95 where there is a slow change so as to counter the rapid change perceived to the eye. 

Turning now to Fig. 21 , there is shown the gamma correction unit 86 in more detail. A gamma correction RAM 97. 
designed to implement the gamma correction curve of Fig. 20. is provided and is loaded via an input 98 from the CPU 
18 during startup of the detection nKXfuIe 14. Input pixel data 100 is input via a latch 101 before being used as the 
address to the gamnrta correction RAM 97 and used to produce a gamma corrected output 1 02. 

The gamma correction RAM 97 stores gamma correction values as pairs of eight bit values, with each pair repre- 
senting gamma corrected values for Input data that is 0 modulo 4. The address of the gamma correction RAM 97 is 
formed from the upper six bits 104 of incoming pixel data. The lower two bits 105 are used to interpolate between the 
pair of gamma corrected output values 102 by an interpolator 106 to produce final gamma con-ected output value 107. 
A video output qualifier 108, which comprises a multiplexer with one input connected to ground. Is provided to blank out 
the output pixel data stream 20 on the occurrence of the detection of a template which Is indicated via a detection signal 
109. 

Referring again to Fig. 18, pixel data areas corresponding to a single cell 26 are 1 28x1 28 pixels wide and are aver- 
aged by a front end accumulator 1 1 1 and accumulated data store 1 12. The accumulated data store 1 12 stores an aver- 
age of each 64x64 block of pixels. The template cells 26 (Rg. 4) are however 128x128 pixels wide. A particular template 
cell is therefore derived from adding together four groups of accumulated data store values by a phase sequencer 1 1 3 
and the result Is stored in a phase RAM 1 1 4. 

Referring now to Fig. 22, there is shown the front end accumulator 1 1 1 of Fig. 18 in more detail. The front end accu- 
mulator 1 11 Is responsible for constructing each 64x64 pixel average and storage of the average in the accumulated 
data store 112 (Fig. 18). The front end accumulator includes a first stage averager 1 1 7 which adds together 64 horizon- 
tally adjacent pixels arriving from the gamma con-ection unit 86. The first stage averager 1 1 7 includes an adder 1 18. a 
latch 1 19 and a counter 120. 

The front end accumulator 1 1 7 reads in pixel values into the adder 1 18. The pixel values are added to a previously 
accumulated sum and stored in tie latch 1 19 thereby forming a new accumulated sum. Each time an overflow condition 
occurs, the counter 120 is incremented (the counter 120 having been reset at the start of each set of 64 pixels). At the 
end of a 64 pixel group, the output to a second stage averager 125 is formed from the four most significant bits from the 
latch 1 19 and four bits from the counter 1 20. 
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Once an average of 64 pixels has been determined it is forwarded to a shift register 126 of a second stage averager 
1 25. Here, the average of the 64 pixels is added to a previous partial sum 127 which is fed from the accunulated data 
store 112 (Rg. 18) and stored in a shift register 128. The two values are added lay a one bit full adder 1 29 before being 
output 130 t>ack to the accumulated data store 1 12 (Fig. 18) via the bus 122. The second stage averager 125 inter- 

5 leaves its access to the accumulated data store 1 1 2 with that required by the phase sequencer 1 1 3 (Rg. 1 8). A control 
unit 132 includes pixel counter 133 and line counter 134 to determine the boarders of lots of 64 pixels in addition to 
decoding logic 135 to generate the necessary control signals for the front end accumulator 1 11 in addition to the nec- 
essary address and control signals 137 for the accumulated data store 112. 

Referring again to Rg. 18, the accumulated data store 112 stores the partally constructed 64x64 pixel cell aver- 

10 ages. The pixel cell averages are constructed and written to the accumulated data store 112 by the front end accumu- 
lator 1 1 1 and read by the phase sequencer 1 1 3 to construct a 1 28 x 128 pixel cell average which is placed in the phase 
store RAM 114. 

Turning to Fig. 23. there is shown the process of construction of 128 x 128 pixel averages from 64 x 64 pixel aver- 
ages. The 128 X 128 pixel cell average constructed will depend upon the phase of the particular cell. The construction 

15 Of the 128 X 128 pixel cells 140 by the phases sequencer 1 1 3 (Fig. 1 8) proceeds in parallel with the construction of the 
subsequent 64 x 64 pixel cell averages 141 by front end accumulator 111. The number of 64 x 64 pixel cell averages 
141 which are required will of course be dependant on the cell size however, it will be assumed, for the purpose of dis- 
cussion of the preferred embodiment, that a maximum of 76 pixel averages 141 are required for one line. In Fig. 24. 
there is shown the arrangement 143 of data stored in the accumulated data store 1 12 (Rg. 18). The required capacity 

£0 of the accumulated data store is 3 rows x 76 columns x 1 4 bits per data entry which gives a total of 3, 1 92 bits of data. 

Referring now to Rg. 25, there is shown the phase sequencer 1 13 of Fig. 18 in more detail The phase sequencer 
113 performs three main tasks including: 

1 . The construction of cell data from the accumulated data store 1 12 by the averaging of four adjacent 64x64 pixel 
25 Ijlocks as illustrated in Rg. 23. 

2. The generation of addresses and the storage of generated data in the phase store RAM 114. 

3. The generation of control and address signals for a conparator matrix 1 15 (Fig. 18). 

The phase sequencer 113 includes a phase accumulator 145 which reads in the four adjacent 64x64 average cell 

30 values from accumulated data store 1 12 and adds them together in an adder 146. Intermediate values are stored in a 
latch 147. The output of the latch 147 is fed back to form one of inputs to the adder 1 46, the other input being via a bidi- 
rectional bus 123 from the accumulated data store 112. Each time an overflow operation occurs in the adder 146, a 
counter 148 Is incremented. An output 150 of the phase accumulator 145 is formed from the four most significant bits 
derived as a result of the addition of the four adjacent cells by the phase accumulator 1 45. This output Is fed to a phase 

35 latch 1 52 before being fonwarded to the phase RAM 1 14 (Fig. 18). 

As shown in Fig. 26, the phase RAM 1 14 is divided into four phase areas designated phase 0 to phase 3. Each 
phase area includes nine rows, corresponding to the height of the template, in addition to 36 columns, corresponding 
to the number of cells in a line, and is four bits deep, with each cell having a 4 bit value or magnitude. 

Referring again to Fig. 25. the phase latch 1 52 builds the data for a whole column of the phase store by effectively 

40 shifting the contents of the phase latch 1 52 by four bits to the right each time new data is received from the phase accu- 
mulator 1 45. TTie 36 bit data is read out and fonwarded to the phase RAM 1 1 4 via a bidirectional bus 1 51 . When reading 
the data t>ack from the phase RAM 114 only 32 bits are utilised with the top four bits being thrown away as they are 
returned to the latch 152 under the control of control logic 154 within a control unit 155. The control unit 155 also 
includes an accumulator data store address generator 156 for generating the requisite addresses for the accumulated 

45 data store 1 1 2 in accordance with the scheme outlined in Fig, 23. Additionally, a phase store address generator 157 is 
provided for generating addresses for the phase RAM 114. 

As will be further discussed hereinafter, the clocking scheme of the detection module 1 4 can. under certain circum- 
stances, be derived from the global pixel stream of the overall copier system 1 . A global dock can be provided by con- 
figuration and control unit 217 (Rg. 18) in accordance with a number of schemes. In the preferred en^xxliment, the 

50 required pixel clocking frequency of the detection module 1 4 is below that of the pixel stream. However, tiie global clock- 
ing scheme of the detection nxxiule 14, designated gclk 158 can. in some emtxxliments. be greater than that of the 
input data stream. Therefore, synchronisation of the clocking speed of the Input pixel data stream must occur relative 
to the glot)al dock (gdk). This occurs via a synchroniser unit 159 which receives the control signals 1 38 and synchro- 
nises a start signal from the front end accumulator 1 1 1 which indicates the start of a new page, in addition to synchro- 

55 nising a ready signal from the front end accumulator 111, which indicates pixel data is ready for reading by the phase 
sequencer 113. 

Turning now to Fig. 27 there is shown the comparator matrix 1 15 of Rg. 18 in nrwre detail. The comparator mati-ix 
1 15 is an important part of the detection nrxxlule 14 as it fadlitates a high rate of comparisons in detecting image data 
from phase data and template data. The conparator matrix 115 reads phase data 162 from the phase data ram 1 14 
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(Rg. 18). in addition to reading template data 163 from a ROM interface unit 164 connected to the ROM interlace 83. 
both of which are supplied to a conrparator array 165 (Fig. 27). The template ROM 1 5 has a series of templates stored 
therein corresponding to the different templates 45 (Rg. 8) for different rotations of a given inage in addition to different 
images. The results of corrparisons performed by the comparator array 165 for each rotation of a template are for- 

5 warded to a series of tally arrays 1 86-1 89. Each tally array 1 86-1 89 determines the number of matches for a particular 
rotation of the template which is to be matched. TTie tally arrays 186-189 output a template detection signal 192 when 
a template match is detected. 

Referring now to Fig. 28, the general principles of operation of the comparator array 165 will now be explained in 
more detail. Data for a band of cells is fed, column by column, out of the phase RAM 1 14. A band of cell data values 

10 consists of columns 228 with each column containing nine 4-bit cell values 229. The data is output from the phase RAM 
114 to the input bus of the comparator array 165, A data value, eg. 229. is then compared 230 with a range of values 
for each oonrparator cell 231 for a whole row 232 of comparator cells. Similarly, the cell value 234 Is compared against 
values stored in the comparator cells of row 235. A similar process is candied out for all the other entries in column 228. 
Referring now to Fig. 29. there is shown a single column 236 of comparator cell entries 231 in addition to corre- 

15 spending column of input entries 228. 

The data value on the input bus corresponding to entry 229 is compared at 230 to determine if It is within a range 
of values stored within the conparator cell 231 . The output signal 239 is therefore high when the data entry 229 is within 
the range of values stored in comparator cell 231 . Similarly, the second data entry 234 is compared at 241 with a range 
of values stored within comparator cell 240 and the output 242 is "ANDed" by AND gate 243. whose other input is the 

20 output 239 from cell 231 . A similar process is carried out for all the other ceils within a column. Therefore, a serially 
obtained output 238 will be active only when all the cell entries of column 236 are activated. TTiis occurs when all the 
cell data values within column 228 are within the ranges of values stored within corresponding comparator cells of col- 
umn 236. 

Referring again to Fig. 28. the output of a column comparison 238 is initially latched 245 and the next column 246 
25 is then forwarded in turn to the comparator array 165. The outputs from the comparator array 165 are fonwarded to a 
first tally array 186 (Fig. 27). Referring now to Figs. 30 and 34, the tally array 186 (Fig, 27) includes a shift register matrix 
250 that consists of a 9x9 an^ay of shift registers 251 that retain a tally of those comparator outputs 238 (Fig. 28) which 
produced positive results. Therefore, assuming that outputs 252. 253 (Fig. 28) are activated when initial column 228 is 
fed to the comparator array 165, then shift register latch entries 255. 256 will store a high value indicating the occur- 
30 rence of this everrt. 

Referring now to Fig. 31 and Fig. 28, in the next clock cycle column 246 is fonvarded to the comparator array 165 
and it is assumed that outputs 258, 259 are activated and latched by the tally an^y entries 261 , 262, with the previous 
entries being shifted to row 263. 

Referring now to Rg. 32 and Rg. 28, in the next dock cycle data column 265 is fonwarded to the comparator matrix 
35 1 65 and, it will be assumed, that output 266 is the only output line activated. This activation is latched 268 (Fig. 32) with 
the previous activation data being shifted down one row to row 269. 

Referring now to Fig. 33, there is shown the criterion necessary for a template detection to have occurred. This con- 
dition occurs when a diagonal of template notches has occurred. This condition will occur when consecutive columns 
of cell data 228 (Fig. 28) are matched by corresponding consecutive columns of the comparator matrix 165. It can be 
40 seen from Rg. 33. that in order to detect the diagonal, it is not necessary to store the lower left hand portion of the prior 
detection data. Hence, the shift registers required for this area can be dispensed with and a consequential saving in 
cost arKl layout area obtained. 

Turning now to Rg 34, there is shown the layout of a tally array 186-189 in more detail. The tally array includes a 
shift register matrix 250. Detection signals 271 are fed from the comparator matrix 165 to a series of shift registers 251 . 
45 AND gate 272 is utilised to detect the occurrence of diagonal validation signals, outputting a detect signal 273 when all 
diagonal shift registers contain active data. 

Referring again to Rg. 27, tally array 186 is designed to detect occurrences of the template in a 0* rotation. The 
comparator array 165 is also designed to allow for simultaneous detection of 90, 180 and 270 degree rotation of the 
template data in the input stream. 
so Referring now to Rg. 35, in order to detect 90* rotations, each column of cell data 228 is also fed into the compa- 
rator array 165 from above. Cell data 228 is compared against the range values contained in all of the cells 231 of col- 
umn 280. Similariy. data entry 234 is compared with all tiie cell entries in column 281 . Also, although not shown, all of 
the other entries in row 228 are compared with values in corresponding columns of the comparator array 165. 

Hie output 283 of a row 284 is obtained in an analogous manner to output 238 of Rg. 28. in that the cell outputs of 
55 each cell in row 284 are ANDed together (not shewn in Rg. 35) to form final output 283. The otiier rows of the compa- 
rator matrix 165 also output values derived in the same manner. 

The outputs of the comparator matrix are latched into shift registers 286 which fornre part of a tally array 188 (Fig. 
27) TTie tally array 188 operates in a similar manner as tally array 186, however, for the 90® rotation case, the opposite 
diagonal must be detected. 
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In order for the comparator matrix 1 65 to simultaneously detect the 180** rotation of the template, an address rem- 
apping scheme is utilised. Turning now to Rg. 36, there is shown a portion of the comparator matrix including the first 
column 236. The input to the comparator matrix 1 65 from the phase RAM 1 1 4 consists of the phase data bus 1 62 which 
includes 36 bits of data divided into nine groups of four bits each. These nine 4 bit values correspond to the nine 4 bit 

5 values of a single column of cell data from the phase RAT^^ 11 4. The output signal 238. which corresponds to the 0° rota- 
tion case, is derived from data values tapped from the bus 162 in a first order. A signal 289, which corresponds to the 
case of 180** rotation, is derived in the same manner as signal 238 but for the fact that the data is tapped off the phase 
data bus 162 in the reverse order. This corresponds to testing for a 180** rotation of the data. The signal for the 180** 
rotation case 289. Is fed to a tally an-ay 1 88 (Fig. 39). This tally array operates in the same manner as the tally array of 

10 Fig. 34 but for the fact that the opposite diagonal is detected. 

Referring now to Rg. 37. the 270° rotation case is formed in a similar manner to the 180* rotation case. Fig. 37 
shows a row 284 of conrtparator cells 231 . The output signal 283 for the 90** rotation case is derived from tapping the 
phase data bus 162 in a first predetermined manner. The 270" rotation case can be derived in the same manner as the 
90** rotation case except for data being tapped off the bus 162 in the reverse order. 

15 Referring now to Rg. 38 there is shown a single comparator eel II 70 in nrrore detail. As will be evident from the pre- 
vious discussion, each comparator cell 1 70 will have four t5us inputs corresponding to the four possible rotations of input 
data. These inputs are designated XDATA1 . XDATA2. YDATA1 . YDATA2 corresponding to the 0, 180. 90 and 270** rota- 
tion cases respectively The external outputs of the comparator an-ay 1 70 are only activated when the comparator cells 
1 70 of an entire row or column, for a particular rotation, all detect valid cases of input data. Therefore, by way of exam- 

20 pie, input line XCOMPJN1 represents the validation signal from a previous cell for data having the same rotation. This 
signal is ANDed by AND gate 292 with a signal 293 whose derivation will be explained further hereinafter. The output 
1 82 from the AND gate 292. XCOMP_OUT1 is then fonwarded to the next cell in the row. 

Signals XDATA2. XC0MPJN2 and XCOMP_OUT2 conrespond to the 180** rotation case and operate in an analo- 
gous manner to the 0** rotation case. Similarly, signals YDATA1. YCOMPJNI and YCOMP_OUT1 con-espond to the 

25 90** rotation case and signals YDATA2. YCX)MP_IN2 and YCX)MP_OUT2 correspond to the 270** rotation case. 

In the preferred embodiment, the template cell data is matched with incoming cell data when each portion of the 
cell data Is within a predetermined range. Therefore, as noted previously, a template's cell data consists of two cell val- 
ues which determined the boundaries of a range of values, A comparator cell 170 matches the input cell data when the 
cell value is within the range defined by the two range values. Therefore for each possit)le rotation, a range determina- 

30 tion means 1 73-1 76 is provided. A data latch 1 72 is loaded with the upper and lower range value for the particular tem- 
plate cell. These upper and lower values are fed to each range determination means 1 73-1 76, for each possible rotation 
within a comparator cell 170. Also fed to the range determination means 173-176 is the particular cell data (eg. 
XDATA1). Each range detemiination means 173-176 consists of two comparators which determine if the XDATA or 
YDATA value is within the range stored in data latch 1 72. outputting a signal 178. 293. 291 , 290 respectively when this 

35 is the case. The template data, which comprises the set of two range values, is forwarded to the data latch 1 72 from the 
template ROM 15 (Fig. 2) by means of a series of shift registers 171. Data is shifted into the comparator matrix from 
one cell's shift register 171 to the next cell's shift register via data bus (ROM_dataJn and ROM_data_out), utilising a 
two phase clocking scheme implemented by a control line 288. Once the template data is in position, it is fonwarded to 
corresponding cell data latch 1 72. 

40 Referring again to Fig. 27, In order to determine if a template matches with a corresponding input stream, the com- 
parator array 1 65 is initially loaded 1 63 with range values from the template ROM 1 5. The cells corresponding to a por- 
tion of the input image are then forwarded on the phase database 162 from the phase RAM 1 14 to the comparator array 
165 where they are tested simultaneously as hereinbefore described for matching with template data. Rotations of 0, 
90. 180 and 270 degrees are simultaneously tested by comparator matrix 165 and tally arrays 186-189 resulting in the 

45 detection signal 1 92 being activated when the template matches with the incoming data 162. 

In order to test other possible templates, the comparator array 165 can be reloaded with a corresponding new tem- 
plate from template ROM 15 and the same cell data fed from the phase RAM 114. 

Turning again to Rg. 18, the four detection outputs 192 from the comparator matrix 115 are fed to a detection 
sequencer 193. The detection sequencer 193 determines if an image has been detected by analysing the template 

50 comparison results from the comparator matrix 1 1 5. As seen to Fig. 10. an image is determined to have been detected 
when a relative position vector 58 between two detected templates 55 and 54 is of an expected magnitude and direc- 
tion. 

In Rg, 39 there is shown the detection sequencer 193 in more detail. The Inputs to the detection sequencer 193, 
include the detection signals 192 from the comparator matrix 115, and x-location and y-location signals 194 that are 
55 irput from the phase sequencer 1 13 (Rg. 25). and which indicate the location of the matched template. Other inputs 
include the template ROM data 198, including the tenplate identification data, delta (A) values and epsilon (e) values. 
This data is fed to a transform data unit 197 which is responsible for outputting transformed data in accordance witin 
Table 3 below (to be described). When the detection signal 1 92 is activated, the template identification number, location 
and orientation of the matched template are read from the template ROM 15, via the transform data unit 197, and via a 
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bus 195 are stored in a template match queue 196. Each entry in the template match queue 196 is 32 bits wide arxJ a 
maximum of 128 entries can be stored In template match queue 196. Fig. 40 illustrates the data format of two entries 
195 of the template match queue 196. Each of these data entries 195 contains a number of fields. A first field 199 is 
either 0 or 1 depending on which of a pair of templates it corresponds to. A second template identification 200 stores 

5 the image number to which the template belongs and is followed by a field 201 corresponding to the rotation of the tem- 
plate. A correlation factor, c is also saved for one of the two dimensions ex or ey 202. One of the correlation factors is 
saved with each entry of the queue and is utilised in determining how much the relative vector 58 of Fig. 10 can change. 

Referring now to Fig. 41. there is shown the format for measuring between two templates A and B. The values Ax 
and Ay are derived from the expected horizontal and vertical offsets respectively In Figs. 42a to 42d. there is shown the 

10 template pair definition 295 which corresponds to a zero degree rotation, in addition to a 90 degree rotation 296. a 180 
degree rotation 297 and a 270 degree rotation 298 respectively 

Upon the detection of a template, the transform data unit 197 of the detection sequencer 193 calculates the 
required x and y position values of the detected templates mate in accordance with Table 3 below. As can be seen from 
Table 3. if the template detected is nearer to the top of the page than Its mate, then the expected vertical position off its 

15 mate is calculated and stored with its own horizontal position, tf the template detected is nearest the bottom of the page, 
the opposite is done and the expected horizontal position of its mate is calculated and stored with its own vertical posi- 
tion. 



Tables 



Half 


Rotation 


First 


Epi 


X 

Position 


Y 

Position 


A 


0 


1 


ex 


Xa 


YA + Ay 


B 


0 


0 


ey 


Xb-Ax 


Yb 


A 


90 


0 


ey 


XA+Ay 


Ya 


B 


90 


1 


ex 


Xb 


Yb + Ax 


A 


180 


0 


ey 


Xa-Ax 


Ya 


B 


180 


1 


£X 


Xb 


Ys + Ay 


A 


270 


1 


ex 


Xa 


Ya + Ax 


B 


270 


0 


ey 


XB+Ay 


Yb 



It can be seen from the above table that both entries for the first and second half of the tenplate will store the ver- 
tical location of the template furthest dawn the page for each rotation. Therefore, once the current line number being 
40 processed by the comparator matrix 1 1 5 is incremented to an extent sufficient to exceed by an appropriate margin the 
position stored within the template entry 195. the template entry can be removed from the template match queue 196. 

At the start of the printing of a new page, the template match queue RAM 196 is reset. This means that all the 
entries in the queue are deleted, leaving the queue empty. A pseudo "C" code description of this action is as follows: 

^ if (first == = 1 I I reset == 1) { 

for (read_addr = 0; read addr < MAXADDR+1; read_addr ++) { 
50 delete (read_addr); 

} 

} 

55 

When a detection signal 192 is received from the comparator matrix 1 15. an "add template" mode is entered. The 
transform data unit 197 is responsible for transforming its inputs 194, 1 98 to the correct fornwt as shown in Fig. 40. This 
data 195 is then stored in the template match queue RAM 196 at the next availat)le location. This can be achieved by 
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the utilisation of a linked list by utilising the bits 0 to 7 of each empty entry 198 of the tenplate nwitch queue to be a 
pointer In a list Therefore, detected template entries can be added to the queue by forming a link list structure. 

With most images, it will be rare for many templates to be found. However, if more than 1 28 template matches occur 
the template match queue 196 will be full. It has been found that, with a full queue, the best strategy is to discard entries 
on a pseudo random basis rather than the normal first-in^irst-out basis. Therefore, a pseudo random number (PRN) 
generator 207 Is provided for randomly determining a queue entry to be deleted. In situations where the queue is not 
full, a write address generator 208 determines the next queue position for writing entries into the template match queue 
196. A pseudo "C" code representation of the "add template" nrxxJe is as follows: 

while (1) { 

wait on (detect ! = 0); 
if ('full) { 

next_addr = TMQ(write_addr) & Oxff; 
TMQ(write_addr) - Xfrom(inputs); 
if (write_addr = = end_addr) { 



full = true; 
} else { 

writeaddr = nextaddr; 
} else { 

TMQCprnaddr) = Xfrom(inputs); 

} 

} 

Turning again to Fig. 39, when not adding new entries to the template queue 196, a control unit 209 causes the 
detection sequencer 193 to othenwise continuously cycle through the template match queue 196 looking for pairs of 
templates that correlate closely enough in position to indicate that an image has been found. The control unit 209 con- 
tinuously causes a read address generator 210 to read entries from the template match queue 196. 

A con-elator 214 takes two sets of data, A and B. and compares their relative identification fields in accordance with 
Table 4 below: 



Table 4 



ID field 


bits 


correlation function 
for iocations A and B 


pair 


1 


A;^B 


face 


8 


A=B 


rotation 


4 


An: B 


orientation 


2 


A=B 


xposition 


6 


|A - B\^cx 


yposition 


7 


|A - Bisey 
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If all the correlation functions match, an Image delected signal 215 is output from correlator 214 and fonwarded to 
a configuration and control unit 217 of Fig. 18. The configuration and control unit 217 (Fig. 18) in turn signals the 
gamma correction unit 86 to blank out all further data and notifies the sequencer controller 12 (Fig. 2) that an image has 
been detected. 

The control unit 209 performs the tenplate match searching process by utilisation of two modes, firstly a "Find 
Base" nxxJe and, secondly a "Find Mate" mode. The Rnd Base mode Includes the searching of the template matching 
queue for a suitable base template. The following pseudo "C" code describes this vno6e: 

{ 

load_base = 0: 

for (read_addr = 0; read addr < MAXADDR+1 &&!load_base; 

read_addr + +) { 
if (Q. first = =0 && (yjoc > Q.y_pos + Q.epi | | end) && 

valid(Q-t_id)) { 

load_base = 1; 

} 

if (Q. first = = 1 && yJoc > Q.y_pos + 3 &<fe valid(Q.t id)) { 
deleieCreadaddr); 

} 

} 

if (ioad_base = = 1) { 

base = (Q.tjd, Q.y_pos, Q.epi, Q.x_pos, Q.rot); 
load_base - 0; 
do {find_mate( );} 

} 

} do always; 

It should be noted that the above code contains two subroutine calls, the first being "delete" and the second being 
1ind_mate". The delete function can be described by the following pseudo "C" code which sets the last address tjits 
and adds the entry to a linked list. 

TMQ(read_addr).t_id = Oxfff; 
if (!full) { 

TMQ(end_addr).next = readaddr; 
} else { 

write_addr = read_addr; 

full = false; 

} 

end_addr = read_addr; 

The f ind_mate function searches for a mate of a previously found base template. This is achieved by searching 
through the queue to determine if the conditions as outlined in Table 4 have been met. A pseudo "C" code representa- 
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tion of this function or mode is as follows: 

forgery = 0; 

for (read_addr = 0; read_addr < MAXADDR+1; read addr ++){ 
if (first = =1 && abs(y_pos - base.y_pos) < = base.epi 

&& abs (Q.x_pos - base.x_pos) < = Q.epi && Q.rot = = base. rot && 
Q.tid == base.t_id){ 
forgery = I; 

} 

if (Q. first) = =0 && Q.y_pos ~= base.y_pos && 

Q.x_pos = = base.x_pos && Q.t id = = base.t id) { 
deleie(read_addr) ; 

} 

} 

} 
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Referring now to Fig. 43. the correlator 214 of Rg. 39 is illustrated in more detail. The con-elator 214, In conjunction 
with the control unit 21 7, is responsible for implementing the methods as outlined by the above pseudo "C" code for the 
Find Base mode, the Rnd Mate mode and the delete function for deleting entries from the template match queue 196 
(Fig. 39), in addition to determining when an entry should be deleted from the template match queue 196. 
30 The template data entry for the first candidate match is fed from the template match queue 1 96 (Rg. 39) to a latch 

300 via a bus 212. The second candidate entry is then fed from the template match queue 1 96 to the correlator 21 4 via 
the bus 21 2. An equality comparator 301 tests for equality of the face, rotation and orientation data from the two entries, 
the first t)eing stored in latch 300 and the second fbnvarded via data lines 212. The output of the equality comparator 

301 is forwarded to AND gates 306, 309. 

35 If the first queue entry, stored in the latch 300. is denoted A and the second queue entry forwarded via queue data 
bus 21 2 is denoted B. then a relational tester 303 tests whether |A - B|^cx and a relational comparator 304 tests for the 
relationship |A • B|^cy. The outputs from the equality comparator 301 . and the relational comparators 303 and 304, in 
addition to a pair indicator line 305. which indicates whether the template on data lines 212 is the first or the second of 
an expected pair, are fed together to the AND gate 306 which outputs a forgery detection signal 215 when all its inputs 

40 are high. 

A template match queue deletion signal 308, denoted deleteO, is activated when the same entry is detected twice. 
The deleteO signal 308 is derived via the AND gate 309 whose inputs are equivalent to those mentioned in the second 
conditional statement in the above pseudo "C" code desaibing the operation of Find Mate mode. They comprise: (0 an 
output from an equality tester 310 which tests for equality of y axis position location of the two templates A. B, (ii) a sec- 
45 ond equality comparator 31 1 which tests for equality of x position, and (i'O a third signal which is derived from the nega- 
tion of the signal 305 indicating the first or second pair member. The fourth signal to the AND gate 309 is the output 
from equality comparator 301 which tests for equality of the face, rotation and orientation information of the two input 
entries A B. 

A second template matching queue deletion signal 315. denoted deletel . is activated when it is no longer possible 
50 for a template within the template matching queue to match with any other template due to the fact that the current y 
address, input in the form of signal 316 is greater than the expected y address of the second matching template plus 
the ey factor. A relational comparator 317 tests for this condition with its output forming one of the inputs to an AND gate 
319. Hence, the AND gate 319 implements the conditional statement as expressed by the second conditional of the 
above mentioned pseudo "C" code desaiption of the Find Base nx)de. 
55 Referring now to Fig. 44, there is shown the transform data unit 1 97 in more detail. The transform data unit 1 97 acts 
under the control of a logic decode state machine 330 which is utilised to control various multiplexers 331-335 in addi- 
tion to adder AN 336. As noted previously, inputs to the transform data unit 197 include a current x and y address 194a. 
194b from the phase sequencer 1 13. in addition to Ax. Ay. ex, ey and template identification data 198a-198e. The output 
data comprises x position and y position values 195a and 195b, calculated in accordance with Table 3, in addition to an 
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e value 195c. template identification data 195d and a pair indicator 195e. Additional inputs include a pair indicator 198f 
and a detection signal 1 92 from the tally arrays 186-189. 

By way of example, the x position value 195a of Table 3 is generated simply through a combining nultiplexer 331 
and multiplexer 332 to input x address 194a and Ax 198a to adder 336. The output Is fed to multiplexer 333. Also fed to 

5 multiplexer 333 is x address 194a. Multiplexer 333 chooses between the two possible addresses under the control of 
decode logic 330 to output x position 195a. The logic decoder 330 is responsible for choosing the appropriate control 
signals for the multiplexers 331 . 332, 333 and the adder 336. The output signal 195b is derived in a similar manner to 
the signal 195a. The multiplexer 335 is utilised under the control of logic decoder 330 to decide whether tiie value of ex 
or ey should be output on output 1 95c. Output 1 95d is derived by adding the queue deletion signals 308, 31 5 to the tem- 

10 plate ID information 198e to form new template ID information 195d. 

Turning again to Fig. 39, tiie pseudo rarxlom number generator 207 is utilised to generate addresses into the tem- 
plate match queue RAM 196 once the queue becomes full. The pseudo random number generator 207 can be inple- 
mented using a number of known methods. For example, one form of implementation is utilising a free running 1 5 bit 
linear feedback shift register, with the feedback being the exclusive NOR of ttie two most significant bits and a two bit 

IS linear feed back shift register. This produces a 2^^-1 long sequence of pseudo random numbers which can be utilised 
to generate six bits of a pseudo random address and a counter for the two most significant bits of the address. 

The write address generator 208 of Rg. 39 generates the next address to write errtries to when a template detect 
signal an'ives from the conparator matrix 1 1 5. The write address generator follows a linked list of deleted queue entries 
and on a write cycle, the location to be written is first read to extract the next write address. Therefore, the write address 

20 generator 208, in conjunction with ttie control unit 209 implements tine portion of the above pseudo "C" code associated 
with the add template mode as previously described. 

In Fig. 45. there is shown the write address generator 208 in more detail. The write address generator includes two 
latches 340, 341 which are utilised in following the linked list chain. The input to tiie first latch 340 is the last read value 
out of the tertplate match queue 196. The address of the last enfry in the linked list is latched in latch 342. An equality 

25 comparator 345 compares the current address node stored in latch 341 with the last address node stored in latch 342 
and produces an output 346 which is high when the two latch addresses are equal and the queue is full. A write enable 
signal 349 is output to tine template match queue RAM for writing addresses to tiie template match queue RAM 196. 
The write enable signal 349 is derived from latch 348 under tiie cortrol of a control signal 350 from the confrol unit 209. 
The latch 348. latches tiie load next signal 351 from the previous link in the link list, the load next signal 351 being 

30 derived from the control unit 209. 

Referring again to Fig. 39. the read address generator 210 generates the addresses for reading the queue during 
the scan to find match template pairs. In Fig. 46, there is shown the read address generator 210 in more detail. The 
read address generator merely implements tiie two "for loops" as previously described in the pseudo "C" code outlined 
above with respect to the Find Base mode and the Find Mate mode. Hence, the read address generator 210 consists 

35 merely of a read latch 353 for holding the current read address and an incrementor 354 for incrementing the address. 
In addition to AND gate 355. The read address generator operates under the control of a clear_read and a load_read 
signal from the conti'ol unit 209. 

In tiie design of the detection nxxJule 14, a number of cost verses performance trade-off decisions can be made. 
The performance of the detection module 14 can be measured in terms of the number of separate images which it can 

40 recognise. Factors limiting tiiis number include: 

1 . The clock frequency of operation of the detection module 14, which will determine how many comparisons can 
be made for each incoming set of video pixel data. The required frequency of ttie clock Ct in the prefen-ed embod- 
iment is given by the following equation: 



2. The access time of the ROM 15 determines how many images can be fetched for comparison for each incoming 
set of video pixel data. The ROM data t>and widtti R| of tiie prefen^ed embodiment is given by tiie following equation: 



45 



Cf ^nTfm^/p{p-m)n 



Equation 1 



so 



Rf ssnTfm*W/2s{p-m)w 



Equation2 



The vanat)les set out in the above equations are defined as follows: 



55 



T = number of bank note templates 

/ s input video pixel data rate 

m = size of the comparator matt-lx in blocks = 9 

p o size of the comparator matrix in pixels « 1 1 52 

n o number of conparators in each element of the comparator matrix « 4 



16 



EP 0 744 705 A2 



10 



IS 



20 



W = width in bits of each piece of template data = 8 
5 e scan line length « 5100 
w = width in bits of the ROM interface 16 

So, with the above numbers, equation (1) becomes: 

C, = 13.76x10'^ Tf/n 

and equation (2) becomes: 

fl, = 8.77x10 "^7/ 
giving the required access time of the ROM as: 

R,= 1140/(7/) 

which also gives: 

C, = 15.7R,/n 

The table below illustrates various operating frequency and ROM access times for differing values of 7 and 

/. 



25 



30 



f 


7 


Cf 




22.5 MHz 


128 


9.92 MHz 


400 ns 


22.5 MHz 


256 


19.84 MHz 


200 ns 


22.5 MHz 


512 


39.68 MHz 


100 ns 


16.8 MHz 


128 


7.41 MHz 


530 ns 


16.8 MHz 


256 


14.82 MHz 


265 ns 



35 

Ideally, the second entry in the above table, where 256 templates T are available is chosen. The required dock fre- 
quency will then be 19.84 MHz and the input clock frequency will be 22.5 MHz. This raises the desirable possibility that 
the fundamental dock Cf of detection module 1 4 can be run directly from the clock of the overall copier system 4, if the 
frequency of the copier system 4 is 22.5 MHz. 

40 The present invention can be used for various apparatus, such as an image scanner, a printer, a copying machine, 
a computer. Such apparatus controls process functions of the apparatus, such as an image data processing, an image 
forming processing. t>ased on the discrimination result of the specific innage. 

The atx>ve description describes only one enixxliment of the present invention and modifications. ot>vious to those 
skilled in the art, can be made thereto without departing from the scope of the invention. For exanple. an alternative 

45 embodiment that merely detects the presence of a template is likely to have a restricted utility but still be partially func- 
tional. Additionally, the sizes of various cells and templates can be altered where different requirements arise. 

Claims 

so 1 . Apparatus for the detection of an image in an input pixel stream, said apparatus comprising: 

(i) image input means for receiving said input pixel stream; 

(ii) cell converter means for forming cell data portions formed from regions of a corresponding image of said 
input pixel stream; 

55 (iii) template storage means for storing at least one template, said template comprising a multiplidty of cell data 

entries derived from the desired image to be detected: and 

(iv) comparator means for comparing said cell data portions of said cell converter means with said nxiltiplicity 
of cell data entries to derive a template detection signal when a predetermined number of said cell data por- 
tions nnatch with said multiplicity of said cell data entries. 
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2. Apparatus as claimed in claim 1 . wherein said muttiplicit/ of cell data entries comprises all said cell data entries 
within said template. 

3. Apparatus as claimed in daim 1 , wherein said cell data entries comprise values delimiting a range of values, and 
5 wherein said cell data portions must occur within said range in order to provide the desired match. 

4. Apparatus as claimed in claim 1 . wherein said comparator means simultaneously compares a column of said cell 
data portions with the whole of said cell data entries of said template to determine if any column of said template 
matches with said column of cell data portions. 

10 

5. Apparatus as claimed in claim 4, wherein said comparator means simultaneously compares a 1 80 degree rotation 
of said column of cell data portions with the whole of said template to determine if any column of said template 
matches with said rotated column of cell data portions. 

15 6. Apparatus as claimed in claim 1 , wherein said comparator means simultaneously conpares a column of said ceil 
data portions with the whole of said template to determine if any column of said template matches with a column 
of a 90 degree rotation of said columns of said template. 

7. Apparatus as claimed in claim 4, 5 or 6, wherein said comparator means simultaneously compares a column of 
20 said cell data portions with the whole of said template to determine if any column of said template matches with a 

column of a 270 degree rotation of said columns of said template. 

8. Apparatus as claimed in claim 1 wherein said template storage means contains multiple templates and said com- 
parator means carries out a comparison for each one of said templates. 

25 

9. Apparatus as claimed in claim 1 wherein said comparator means loads a subsequent template while simultane- 
ously can-ying our said comparisons of said cell data portions of said ceil converter means with said multiplicity of 
cell data entries. 

30 10. Apparatus for the detection of an image in an input pixel stream, said apparatus comprising: 

(i) image input means for receiving said input pixel stream; 

(ii) cell converter means for forming cell data portions from overlapping regions of said pixel stream, said cell 
data portions being divided into a series of phases with each of said phases having cell data portions derived 

35 from non-overlapping regions, 

(iii*) template storage means for storing at least one template, said template comprising a multiplicity of cell data 
entries derived from a desired image to be detected; and 

(iv) comparator means for comparing said cell data of each of said series of phases of said cell converter 
means with said multiplicity of cell data entries to derive a template detection signal when a predetermined 

40 number of said cell data portions match with said multiplicity of said cell data entries. 

11. Apparatus as claimed in claim 10, further comprising: 

(v) detected template storage means for storage of a plurality of template entries, with each said template entry 
45 including detected location data corresponding to a location of the template detected by said template detec- 
tion signal; and 

(vi) dual template detection means for detecting an occurrence of two templates from the same image in said 
pixel stream. 

so 12. Apparatus as claimed in claim 11, wherein said dual template detection means includes distance determination 
means for determining the distance between the detected location data of said detected templates. 

13. Apparatus as claimed in claim 12, wherein said distance determination means includes distance comparator 
means for determining if said distance between the detected location data is substantially the same as an expected 

55 predetermined distance between said detected templates. 

14. Apparatus as claimed in claim 12 or 13, wherein said distance is a vector measure having magnitude and direc- 
tional components. 
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15. Apparatus as claimed in claim 10, wherein said cell data portions include a data value derived from of a group of 
pixels, said pixels covering a two dimensional area of said image. 

16. Apparatus as claimed in daim 15, wtierein said cell converter means forms multiple sets of said cell data portions, 
with each set of said cell data portions tseing composed from a contiguous two dimensional area of pixels in the 
input pixel stream. 

17. Apparatus for comparing a first predetermined array of cell data values with a second predetermined an-ay of tem- 
plate data values, said apparatus comprising: 

(i) input means for inputting, a column at a time, said first predetermined array of cell data values to a compa- 
rator matrix means; 

(ii) a corrparator matrix means for simultaneously determining if said column of cell data values matches with 
any of a plurality of columns of said second predetermined array of tenrplate data values and to produce a col- 
umn matching signal designating the said matched column of said second predetermined array of tenplate 
data values; 

(iii) tally array means for storing said column matching signals for a series of columns of said first predeter- 
mined array of celt data values, and 

(iv) template match detection means for deriving from said stored column matching signals, a template match 
signal signifying the occun-ence of a match between said template and a portion of said first predetermined 
array of cell data values. 

18. Apparatus as claimed in claim 17. wherein: 

said comparator matrix means simultaneously determines ii said column of cell data values matches with 
any of a plurality of columns of a predetermined number of rotations of said second predetermined array of tem- 
plate data values and produces a rotated column matching signal designating said matched column of said prede- 
termined number of rotations of said second predetermined an^y of template data values; 

said tally array further includes means for storing said rotated column nnatching signals for a series of col- 
umns of said first predetermined array of cell data values; and 

said tenplate match detection means furtiier includes means to derive, from said stored rotated column 
matching signals, a template match signal signifying the occurrence of a match between a rotation of said template 
and a portion of said first predetermined array of cell data values. 

19. Apparatus as claimed in claim 17, wherein: 

said comparator matrix means simultaneously determines if said column of cell data values matches with 
any of a plurality of rows of said second predetermined array of template data values and produces a row matching 
signal designating the said matched row of said second predetermined array of template data values; said appara- 
tus further comprising: 

second tally array means for storing said row matching signals for a series of columns of said first predeter- 
mined array of cell data values, and 

second template match detection means for deriving from said stored row matching signals, a second tem- 
plate match signal signifying the occunrence of a match between said template and a portion of said first predeter- 
mined array of cell data values. 

20. Apparatus as daimed in claim 17 or 18, wherein a template data value comprises two numbers which delimit a 
range of values, and wherein a column of cell data values matches a conresponding column of said template data 
values when each of said cell data values is witiiin the range delimited by said template data value. 

21 . Apparatus as claimed in claim 18 wherein said rotations indude sut>starrtially 90, 180 and 270 degrees. 

22. Apparatus as claimed in claim 17 wherein tiie numt>er of elements of said column of cell data values is tine same 
as the number of values in said column of said second predetermined array of template data values. 

23. An image processing method comprising the steps of: 

inputting image data representing an input inrtage; 

determining whether the input image includes a first pattern extracted from a first region of a specific image 
and generating a first determination result; 

determining whetiier the input image indudes a second pattern ext^cted from in a second region of the spe- 
cific image and generating a second determination result; and 
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cfisaiminating whether the input image includes the specific image based on the first and second determi- 
nation results and positional information atxsut the first and second regions. 

24. A method according to claim 23. wherein the image data is colour conponent data which is used for forming a col- 
5 our image. 

25. A method according to daim 24, wherein the colour component data is selected one of Cyan. Magenta. Yellow and 
Black 

70 26. A method according to daim 23, further comprising the step of performing density conversion on the image data 
before the determinations. 

27. A method according to claim 23. wherein said discrimination is performed in synchronism with the input of said 
image data. 

15 

28. A method according to daim 23. wherein said first and second regions correspond to N x M pixel block. 

29. A method according to daim 23. wherein said positional information includes distance infornnation and direction 
information. 

20 

30. A method according to claim 23, further comprising tie step of controlling an image processing apparatus based on 
the disCTimination result. 

31. An image processing method comprising the steps of: 
25 inputting image data representing an input image: 

extracting multi-value data for each of a plurality of cells con-esponding to a region of the input image; and 
discriminating whether the input image includes a specific image by comparing the extracted multi-value 
data with multi-value template data for each of a plurality of cells corresponding to a region of the specific image. 

30 32. A method according to claim 31 , wherein the image data is colour component data which is used for forming a col- 
our image. 

33. A method according to daim 32. wherein the colour component data is selected one of Cyan. Magenta, Yellow and 
Black. 

35 

34. A method according to claim 31. wherein said discrimination is performed in synchronism with the input of same 
image data. 

35. A method according to claim 31 . wherein said multi-value template data has a margin for controlling a quality of the 
40 discrimination. 

36. A method according to claim 31 . further comprising the step of controlling an inrwge processing apparatus based 
on the disaimination result. 

45 37. An image processing method comprising the steps of: 

inputting image data representing an input image: 

extracting cell data for each of a plurality of cells corresponding to a first region of the input image; and 
discriminating whether the input image indudes a specific image by comparing the exta-acted cell data witii 
template data for each of a plurality of cells corresponding to a second region of the specific image; 
so wherein the discrimination is performed by compensating a minute aberration between tiie first region of tiie 

input image and the second region of the specific image. 

38. A method according to claim 37. wherein the image data is colour component data which is used for forming a col- 
our image. 

55 

39. A method according to daim 38, wherein the colour component data is selected one of Cyan. Magenta, Yellow and 
Black. 
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40. A method according to daim 37, wherein said discrimination is performed in synchronism with the input of said 
- image data. 

41 . A method according to daim 37, wherein said minute aberration is smaller than a size of the cell. 

42. A method according to claim 37, further comprising the step of controlling an image processing apparatus based 
on the disaimination result. 
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